Papers with Transformer network
A logical-based corpus for cross-lingual evaluation (D19-61)
Copied to clipboard
| Challenge: | a recent study shows that deep learning models can be used to solve textual inference tasks using simple linguistic patterns. |
| Approach: | They propose a set of syntactic tasks focused on contradiction detection that exploit linguistic patterns. |
| Outcome: | The proposed tasks can be implemented in English and Portuguese. |
Transformer-GCRF: Recovering Chinese Dropped Pronouns with General Conditional Random Fields (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to recover dropped pronouns ignore the dependencies between pronounes in neighboring utterances. |
| Approach: | They propose a framework that combines Transformer network and General Conditional Random Fields to model the dependencies between pronouns in neighboring utterances. |
| Outcome: | The proposed framework outperforms state-of-the-art models on three Chinese conversation datasets showing that it captures the dependencies between pronouns in neighboring utterances. |
SYSTRAN @ WNGT 2019: DGT Task (D19-56)
Copied to clipboard
| Challenge: | SYSTRAN participates in Document-level generation and trans-lation (DGT) task . data-to-text generation tasks are difficult because of the content selection and text generation data. |
| Approach: | They propose a Transformer-based datato-text generation model which jointly learns content selection and text generation. |
| Outcome: | The proposed model outperforms current state-of-the-art system on BLEU, content selection precision and content ordering metics. |
Efficiency through Auto-Sizing: Notre Dame NLP’s Submission to the WNGT 2019 Efficiency Task (D19-56)
Copied to clipboard
| Challenge: | Notre Dame Natural Language Processing group applied auto-sizing to the Transformer network to reduce the number of parameters in the model. |
| Approach: | They investigated the impact of auto-sizing on the Transformer network by applying a method to inducing sparsity in parameters. |
| Outcome: | The proposed method eliminated more than 25% of the model’s parameters while suffering a decrease of only 1.1 BLEU. |
Explore More Guidance: A Task-aware Instruction Network for Sign Language Translation Enhanced with Data Augmentation (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing studies focus on the recognition step, while paying less attention to sign language translation. |
| Approach: | They propose a task-aware instruction network, namely TIN-SLT, for sign language translation, by introducing the isntruction module and the learning-based feature fuse strategy into a Transformer network. |
| Outcome: | The proposed system outperforms existing solutions on two benchmark datasets, PHOENIX-2014-T and ASLG-PC12, and outperformed previous best solutions by 1.65 and 1.42 in terms of BLEU-4. |